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ABSTRACT 



The method and apparatos for generating a reference video 
sequence of images includes performing a grid analysis of 
each of the frames of the video sequence, assigning a color 
value to that frame, calculating the difference in total color 
value between frames in the video sequence, establishing a 
threshold value for transitions and dropping those frames 
whose transitions from frame to frame are below the thresh- 
old value. The reference video analysis may be perfoimed 
on a single user system or over a network system including 
a number of workstations. 

17 Claims, 3 Drawing Sheets 
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METHOD AND APPARATUS FOR 
COMPRESSING AND ANALYZING VIDEO 
AND FOR CREATING A REFERENCE VTOEO 

FIELD OF THE INVBNnON 

The invention relates generally to systems and methods 
for editing and composing audiovisual and motion picture 
material and more particularly to providing users easy 
analysis of a video sequence via selective compression of 
digital, video. 

In video applications, analog video is digitized and stored 
on appropriate magnetic or electro-optic media in a com- 
pressed fonn for later retrieval for purposes of editing. 
Digital video by its nature typically requires large amounts 
of storage. The amount of storage required is a function of 
the image size, the number of frames per second, color 
resolution and the compression- algorithm chosen. 

While there have been many advances in the density of 
storage of information on present day media and advances in 
the compression of video data via various algorithms, 
nevertheless, storage requirements on the order of 10 kilo- 
bytes per frame remain typical even today. Thus, even with 
modem storage techniques and advanced compression 
algorithms, the computer system still requires a very large 
disk cq)acity in order to manipulate large amounts of video. 
As digital video applications become available to users of 
PCs, PCs are required to be equq)ped with higher and higher 
capacity disks in order to run video applications such as 
tutorials or other full length productions. As the competition 
has increased in an effort to squeeze more and more video 
onto existing storage media, a number of conq>eting com- 
pression schemes have evolved. Each of these schemes use 
different conqiression algcaithms. They all work on the basic 
principle of preserving each video frame and compressing 
every video frame more or less efficiently according to the 
algorithm chosen. 

The prior art schemes, although using different 
algorithms, still work on the basic principle of "lifeless" 
compressed video such that each and every frame can be 
decompressed as required For example, in the MPEG 
compression standard a video stream is comjEessed by 
storing only an encoded version of calculated differences 
between successive video frames. This compression stan- 
dard is computationally intensive. In a JPEG con^iression 
scheme, compression is based on a discrete cosine transform 
of the image and run lengtfi encoding. 

SUMMARY OF THE INVENTION 

In general, the present invention pertains to a method and 
q)paratus for analyzing the content of a frame of video and 
for performing compression or other activity based on this 
analysis. For example, a method of compressing video based 
on this analysis drastically reduces the amount of storage 
required by selectively deleting one or more of the video 
frames, the frnal asscinbly of frames without deleted frames 
being termed a **reference video"*. Storage space is not 
wasted for images which are substantially the same as the 
images in a previous frame or frames. This analysis can also 
be used to provide for intelligent and dynamic elimination of 
frames from video information being transmitted, for 
exanq^le, over a compnter network. It may also be used for 
scene d^ecdon. 

The invwitors have observed that in many video applica- 
tions not all the frames are in^Kntant if the viewer cares only 
about the information content as opposed to tiie aesthetic 
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value of the video pictures. As an example, ff the video 
application is a newscast with the camera focused upon the 
upper body of the newscast^' in which there is alinost no 
body movement and only movement of the lips of the 

5 newscaster, compressing each of the many frames which 
form a sequence of the newscast wastes space in view of the 
miniTnal movcmcnt and thus the minimal difference between 
each of the frames. If all that is required in an educational 
or tutorial program is that the speaker is a newscaster and it 
does not matter much whether the newscaster's lips are seen 
to move all of 30 seconds or a minute or longer, video 
sequences may be eliminated without losing the informa- 
tional content of the video. Thus, all frames oth^ than a first 
frame and perhaps a last frame may be deleted and the entire 
sequence may be rq)laced by a single frame that is played 

^5 for the full period of the audio. The audio portion corre- 
sponding to the video segment is either preserved in full or 
may be compressed using known techniques. 

For example, if an entire sequence is 30 seconds and 
given a typical video speed of 30 frames per second, 30 

20 seconds of video amounts to 900 frames so that 898 or 899 
out of the 900 frames can be dropped. This is a tremendous 
savings of storage space. 

In the present invention a reference video is made by 
selectively deleting frames when effectively "nothing much 

25 is happening" in the video, that is, when the amount of 
change from frame to frame during a given segment of time 
does not differ suf&cicntly to warrant compression of each 
and every video frame. Thus, in the present invention, a 
•^reference** of the video segment is preserved and continu- 

3Q ously rq>layed while the audio content, if any, is played in 
full. While this methodology may result in the loss of some 
smoothness (in the example the newscaster's lips would not 
be moving) nevertheless in many applications it is more 
desirable to conserve storage space at the price of a fiilly 
conqiressed sequence in which the newscaster's lips are seen 
to move. This method is also useful for reducing an amount 
of video information transmitted over a cpmputer network, 
particularly where bandwidth may be limited. 
Thus, the present invention relates to a video analysis 

^ system which decides when "nothing much is happening", 
that is, when a value indicative of the amount of change or 
transition from one frame to another is bdow a minimal 
change value or threshold set by the user. When the amount 
of change between a first and a subsequent second fr^me is 
below the threshold, the subsequent frame is sin[^)ly deleted, 
for compression, or not transmitted in a computer network. 
The results of analysis may also be used for scene detection. 

- If, however, the amount of change exceeds the threshold, 
then that frame will be preserved and may even be com- 
pressed using any known compression algorithnL 

It is also an object of the invention to provide a system 
which analyzes content of a video frame. 

It is also an object of the present invention to generate and 
retain information regarding frame difference to use as a 
basis for scene-identification in a video program. 

Thus, it is an object of the present invention to provide a 
novel compression methodology in which selective frames 
are dropped if the diange value of the frame is below a 
certain threshold. 

60 It is also an object of the present invention to drastically 
reduce the amount of stcH^e space required conqiared to 
prior art compression algorithms by selectively deleting 
certain frames for purposes of storage. 
It is also an object of the present invention to provide a 

65 system and method for conqiression which facilitates the use 
of video techniques on PCs even without large capacity 
storage media. 
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It is yet a further object of the present invention to provide 2« a video &ame 30 is shown as a grid of 20 pixels wide (32) 

a compression algorithm which can be selectively set to and 12 pixels (34) high. While the grid of 20x12 pixels has 

certain thresholds to allow for selectively storing different been illustrated, naturally the invention should not be read to 

levels of detaU of a video sequence on a storage media. be limited to this particular size grid. Hie grid size is 

It is still further an object of the present invention to 5 preferably a function of the dimensions of the image or die 

provide a method and ^paratus for increasing the through- frame size. While the inventors have found that the 20x12 

part of video images or a network system. pixel grid may be sufBdent for certain types of video, any 

numb^ of pixels in a grid may be chosen depending upon 

BRIEF DESCRimON OF THE DRAWINGS the amount of detail which is desired and upon the particular 

For a better understanding of the present invention content of the information which is contained in each of the 

together with other and further objects, advantages and frames.Thus,thegridmay be changed as desired to alter the 

capabilities thereof, reference is made to the accompanying granularity or resolution of the analysis by the invention of 

drawings which arc incorporated herein by reference and in ^® present system. In operation, the program 20 analyzes 

which: each frame 30 by comparing the color values (whether RGB 

FIG. 1 is a block diagram of a video picture composing (red, green and blue), CMYK (cyan, magenta, yeUow and 

system according to the present invention; black)orYUVOuminanceandchrominance)colorencoding 

HG. 2 is a representation of the video frame grid which '^^^^^J^' ^ f « f ^ corresponding 

is analyzed- ^ ^ previous frame. In order to maintam consistency. 

^ ! , . , the grid patterns are maintained the same for a particular 

FIG. 3 IS a visuakzation bit map for a given video ^^e^ ^^^^^^^ ^^^^ compressed. Once the color 

segment; ^ values of each pixel in the 20x12 grid has been compared 

FIG. 4 illustrates a display of video sequence images in with the corresponding pixel in the previous frame, a total 

accordance with the present invention; and color count CTCC) per frame is computed by the computer 

FIG. 5 illustrates a network system in accordance with the 14. The TCC is the sum of all its color values for all of the 

present invention. 25 pixels in the grid. The algorithm which calculates TCC, 

DESCRimON OF THE PREFERRED ^^"'^ ^ ^^"^^ ^ ^ 

EMBODIMENT TCOZ^ {JLed(Pf,}^Qtccn (FyHBIue 

Referring now to FIG. 1, an exemplary video picture As can be seen by the above equation fOT each pixel Pij, 
composition system 1*0 according to the invention includes 30 the red, green and blue values are summed for aU the pixels 
a source 12 of video information. This information may be in the frame. The sum TCC is an integer (typically of 32 or 
information which is contained on magnetic tape and con- 64 bits) which is then computed for the next succeeding 
stitutes the entire amount of frames in a given video frame in the video sequence and the absolute value of the 
sequence. It may also be any other type of storage media difference is calculated. If the difference of TCC from one 
which contains video information, such as video disks, 35 frame to the next is greater than a certain number called the 
CD-ROM information or may even be a camera which is threshold, then the second frame is called a transition and is 
capturing video images "on the fl/* or, input over a com- kept However, if the difference in the value TCC from one 
puter network of digital video information. The information frame to the next is less than or equal to the number defined 
contained within the block 12 thus is the plurality of frames as. the threshold, then that succeeding frame is identified as 
comprising any given video sequence or video sequences. A 40 containing an insignificant change and may be dropped or 
conq)uting system which may be, for example, an Apple deleted. Thus, the larger the difference in TCC from one 
Macintosh or IBM-type personal conq)uter (PC) 14, receives frame to a succeeding frame, the greater the transition from 
the full sequence of frames from the source 12. Many other one frame to the next. The threshold value default is set to 
computers may be used; the invention is not limited to these 2000, ^vhich has been found by the inventors empirically to 
types of cornputers. A data path 16 links the storage medium 45 yield good results in determining transitions for video mate- 
to the irput medium 12 to the computer 14. Contained rial using a 20x12 grid. However, the threshold value default 
within the computer 14 is a program 18 which contains a of 2000 may be adjusted by the user as desired. This 
media storage and playback of video and audio information threshold may also be dynamically adjusted to allow for 
system such as that shown in Peters et aL, "Video and Audio even better choices for frame deletion in varied material. By 
Transmission System and Method", U.S. Pat No. 5,045,940 50 choosing a higher number, for example, the user can cause 
issued Sep. 3, 1991, the content of which is herein incor- more frames to be dropped. This would result in a smaller 
porated by reference. The computer may also include a amount of information to be stored but the corresponding 
second program 20 which incorporates the reference video video would naturally appear more choppy, 
system and method of the present invention, to be described By choosing a lower threshold value default, the user can 
below. Furthermore, the computer contains a display inter- 55 cause fewer frames to be dropped. This would result, 
face 22, shown in greater detail in FIG. 3, which displays the naturally, in a larger amount of information to be stored but 
results of the reference video compressed according to the the corresponding video would appear smoother. Once all 
jffesent invention. Furthermore, the computer system 14 has the frames of a selected video sequence have been analyzed 
associated with it a high speed, high capacity internal or according to the selected video threshold value, die results 
external magnetic hard disk drive 24 which may contain, $0 are stored in a data structure so that the program can 
among other things, the video sequence compressed accord- instantly determine whether any particular frame is a tran- 
ing to the present invention, i.e.. the r^crcncc video. The sition or not without performing the calculations again. This 
computer may be connected directly to the drive 24 or data may be stored in or near the video file itself. As analysis 
receive the reference video over a network. As stated above, progresses, each frame's TCC is stored in an array. Also, a 
the present invention will analyze each video frame. 65 visualization bit map is stored in or near the video file and 

Turning now to FIG. 2, HG. 2 shows a grid that is selected is constructed as the video is analyzed. Thus, for each of the 

to be 20 pixels wide and 12 pixels high. As ^own in FIG. frames a transition value is associated with each frame and 
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Stared to be used at a later time in adjusting the resulting is little or no movement or transition of scenes, the reference 

video, as will be described below. video drops many extraneous frames. 

An important refinement of the present invention is that In the analysis and composing of a particular video 

the algoiidmi may compare each frame's TCC, not to the sequence, it is useful for the user to have an overall snapshot 

previous frame's total TCC, but to die previous transition s picture of die transitions during a full video sequence. This 

frame 'sTCC The transition frame is a previous frame whidi is accomplished through what the inventors term 'Video 

has been kept because it has exceeded die sdected threshold visualization." Video visualization is a way of viewing a 

value. The purpose of comparing each frame's total color portion of die entire video sequence at a glance on the screen 

count to the previous transition frame's TCC is to correctly 22 of the computer systan. For example,, a video clip may 

analyze certain video sequences such as a panning shot In lo start with a scene A then cut to scene B then to scene then 

a panning shot each fmnt differs only a little from the back to A and back to C so that the overall video sequence 

preceding frame while the overall effect over a number of structure is ABCAC Previously, there was no way to see this 

frames adds to a significant change over several frames. By structure without viewing the entire video sequentially, 

utilizing the last transition frame as a basis for comparison, Video visualization provides a means to view the overall 

the computer insures that it will keep a frame when the 15 structure without viewing the entire video. This is accom- 

accumulated difference exceeds the threshold set plished during the analysis phase described above as the 

Once the coniputcr has analyzed the frames in a video program examines die 12 by 20 grid for each frame. While 

sequence in accordance witti a selected threshold value in a doing so, it also builds a bit m^ whidi is called the 

set grid pattera, the results are stored in a memory device **visualization bit map". This bit m^ is 1 pixel wide (of the 

which may cither be a dynamic type of memory contained 20 20 pixels in our example) and 12 pixels high (for the grid 

within the computer 14 or on the disk 24. The user may then described above) for each frame of the video. Thus, if the 

play back the reference video to see how it appears. If die video sequence contains 500 frames, die bit map is 500 

resulting video sequence appears too choppy or unnecessar- pixels wide and 12 pixels high. Obviously, the bit map is 

ily smooth, die user may manually add or drop frames to his usually chosen to be as many pixels high as the grid used to 

liking by adjusting the du^hold as described above. Since 25 generate die transition analysis. If die grid is 10 pixels high, 

the system has kept a record of the TCC of each frame, this then die visualization bit map will be 10 pixels high and the 

manual addition or detection of frames may be accom- visualization bit map in this example would be 10 high by 

plished without recalculating for each video frame its TCC. 500 wide. As each frame is analyzed for transitions in its 

When the user is satisfied with the content of the presen- grid, the cent^ vertical slice of the grid shown as 36 in FIG. 

tation of the video sequence, the user may cause the program 30 2 is copied to a visualization bit map file. Thus, the resulting 

to issue a "Save Reference Video" or odicr command, bit map for the entire video sequence contains a very small 

whereupon the program copies each frame in the original sample (Le., one pixel wide) from every frame in the video 

source file to a new reference video file, in the process sequence. Of course, the user may select the center vertical 

eliminating the dropped or deleted frames as it goes. Ihe sUce of the grid to have any reasonable width not greater 

resulting reference video is an exact copy of the original 35 than the frame width such as 2 bits. Thus, the resulting bit 

video sequence in which a number of frames have been map contains a very small sample from every frame in the 

dropped. The user may also wish to consider only the video sequence. While much of the information is lost, 

analysis information which can be stored without writing of enough is retained to get an overall picture of the entire 

the reference video. sequence enough to create a scene of large motions, color 

It has been found that this reference video file is usually 40 changes and most scene transitions and in general to discern 

much smaller than the original although the compression the overall structure discussed with respect to die ABCAC 

obtained depends upon die video content It has been found example discussed above. While it is preferred to utilize die 

that typically die compression range is from 10: 1 to 100: 1. center slice of each of the frames, it is obvious that any other 

This is, of course, in addition to whatever normal comprcs- slice may be chosen within the frame such as the leading or 

sion may be used on die frames themselves. The reference 45 the trailing edge of the fr^me or any slice between die 

video file can be written to a separate disk file or another file, leading and trailing edges, but preferably any even diagonal 

as desired In normal circumstances, the reference video file slice. 

in any appropriate video file format, such as an Audio-Video FIG. 3 illustrates a visualization bit map 40 on the screen 
Interleaved (AVI) file unless diat file resides on a read-only 22 of die con^Hiter 14. As seen in FIG. 3, die visualization 
device, such as a CD-ROM or to a write-protected file. In 50 bit map 42 is displayed along die bottom of die screen. The 
this case, it is written to a separate file. It can be stored visualization bit map is comprised of two con4)onents, an 
anywhere so long as it is associated with the video file. The upper portion 44 containing the visualization bit map con- 
information in the reference video file includes the new taining the slice from each of the frames in the video 
analysis information, and may include a transition bit map sequence and a lower half timeline 46 which has marked on 
(which frames have been determined to be transition 55 itscene transitions, to be discussedbelow. Hie lower portion 
frames), a visualization bit map, to be discussed below, and 46 forms half of a time line which the time line has a vertical 
other related information (for exan[q}le, if the analysis was slider 48 that the user can move along the visualization bit 
interrupted, the number of the last frame analyzed). m^ 44 using a mouse or other device 26 shown in FIG. 1 
As a result of the above analysis, frames may be dropped in order to move back and forth within the visualization bit 
(e.g., during storage or transmission) only when it is appro- 60 m^. 

priate that such frames be dropped according to the content With the background for the timeline it makes it easier for 

of die video file, size of the grid and whether the frames the user to navigate through the video since he or she can sec 

exceed the threshold value from one previous transition the entire sequence of the video and thus see *Vhere he or 

frame's TCC to the next Thus, if the video under review she is going". The means for determiidng and displaying the 

contains a large amount of transitions, no or almost no 65 slide transitioos 46 on die scale 44 will now be described, 

frames are dropped and the user sees the full original It is useM in a transition analysis to determine and 

sequence of frames in a video sequence. However, if diere display the scene transitions within the given video 
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sequence. Thus. wheQ the camera cuts from a close-up of a shown in FIG. 5, a network system is shown in a block 

head to a shot of a beach or from a commercial to the main diagram. HG. 5 illustrates a network system 70 which 

prograoL the means which performed the analysis of tiie grid comprises a central file servo' 72 and a number of worksta- 

on each of the frames is utilized. The only difference is that tions 74, 76, 78 and 80 connected through a suitable netwc^k 

a higher threshold is used so that only strong transitions 5 82 which may be of a Ethernet-type or other type network 

count as scenes. Thus, if the reference video threshold is set wiiich is well-known in the art The network file server 72 

as described above at 2000, the user might set the scene contains the actual video files which may be desired to be 

threshold at 4000 (which is a dimensionless user-selected used by the user at one of the workstations 74, 76, 78, 80. 

arbitrary number derived from the TCQ. Obviously, the While the user may be accessing the video file from the file 

level of the scene thresholds like the reference video lo server 72, other workstations on the network similarly may 

threshold, may be determined by the user after some expcri- be attempting to access other video files contained on the 

mentation and is dependent upon the particular video network file server 72, As **tra£5c** builds up on the network, 

sequence which is being displayed. In addition, the user may delays may occur as various workstations "contend" for 

set the minimum length for &ie scenes. For exanqile, the user access to die video files contained on the file server 72. 

might want to find and have displayed all scenes which are 15 While networks themselves such as Ethernet include proto- 

at least 3 seconds long. When the user commands a system cols which attempt to reduce the number of interferences 

to find the scenes, the same transition information obtained between requesting workstations, nevertheless on a crowded 

during the grid analysis is used to find all transitions at least network delays may occur. 

3 seconds long that exceed the set preestablished scene Since video information typically consumes a great deal 

threshold. Thus, if any segments arc shorter than the 20 of network bandwidth, the possibility of contentions on a 

requested minimum duration, they are merged and do not aowded video image network increase as compared to other 

appear as screen thresholds. data communication. The network system 70 of FIG. 5 may 

FIG. 3 shows the resulting scene transitions indicated by reduce contentions and increase throughput on the network 

thin vertical lines 50 on the timeline 46. Thus, the overall by implementing a modified version of the reference video 

information presented to the user in FIG. 3 is a visualization 25 analysis described above with respect to the embodiments of 

bit ra^ of the activity during an entire video sequence as FIGS. 1-4. Thus, the network file server 72 contains a 

well as any scene transactions within that video sequence. program 84 which is similar to the program 20 described 

While the video visualization bit map 44 shows the entire with respert to the embodiment of FIGS. 1-4. Program 84 

number of frames in a video sequence, the user may desire will similariy perform a transition analysis of each of the 

to select a particular subsequence of the video sequence to 30 frames, set a threshold then determine whether each suc- 

work witii. For example, frames 200 to 300 of a 500 frame cecding frame is considered a transition. In the single user 

sequence. When selecting a subset of the video sequence, a form of tiie invention described in FIGS. 1-4, tiie threshold 

new visualization bit map and time line wiU appear similar value may be set by the user for a particular video sequence, 

to the display 44 of FIG. 3 either below or above the original and it is generally intended that the threshold value wiJl 

video visualization bit map 42. Further visualization time 35 remain constant during the analysis described above, 

lines for subsequences may also be accommodated in the However, for purposes of utilizing the reference video 

display 42. analysis in a network environment, while a constant tiiresh- 

Anotiier feature of the present invention is tiie ability in old value may be utilized, it is preferred tfiat the threshold 

certain circumstances should the user desire to conserve value be variable and changed dynamically as required. If a 

storage space to provide a viewing of a video sequence by 40 user at workstation 74 requests a video file which is housed 

viewing in full image only the reference video as com- in tiie network file server 72 for his or her use in editing, 

pressed in accordance with the analysis described above as composing or simple viewing, and (he network file server is 

well as a full motion video of a reduced size. For example, at that tune busy serving other workstations, the file server 

as shown in FIG. 4, a display saccn 50 contains a number will send the user at workstation 74 the reference video 

of images. Display 52 is the full size display of tiie reference 45 ratiier ttian tiie full lengtii video because die program 84 

video as described above. Display 54 is the visualization bit contains the analysis of the video sequence which the user 

map and time line display described above and display 56 is at workstation 74 requires. If the traffic on the network is not 

a miniaturized display which may be of any small size, such busy, however, the full length video sequence would be sent 

as 60 by 80 pixels, of the full motion of the video sequence. to tiie user at workstation 74. 

Providing a miniaturized or reduced size version of tiie full so However, as described above, the reference video may be 

video of only, for example 60 by 80 pixels in size, consid- dynamic in form rather than static by applying a dynainic 

erably reduces tiie amount of storage space required for that variable tiireshold value. Since the program 84 has retained 

particular video sequence. Thus, tfie user, once he or she has an analysis of each of the frames of the video sequence (and 

had tiie program 20 perform an analysis of tiie video thus a measure of the transition value from frame to frame) 

sequence and produced a reference video, may view tfic 55 as trafiBc in ttie network increases, it becomes iiiq)ractical or 

entire video sequence by viewing the screen 50 as shown in is too time consuming to send ftiU lengtii video to a user at 

FIG. 4. The user will observe a visualization bit map 58* and a workstation. Since the transition analysis information 

a time line 60' as the video sequence moves from frame to provides a number indicating the strength of the transition 

frame. On screen 52, the reference video will be displayed from each frame to tiie next, a prioritization of frames in die 

in which all or partial movement will be elimiaated. 60 video sequence already exists. Thus, as the network output 

However, if the user wishes to see tiie full motion of die degrades due to multiple contentions, the least important, 

video sequence, he or she can look at ttie display 56 which tiiat is, tiie frames witii the least amount of transition would 

shows the miniature or full display video. The user may be first dropped and die remaining frames sent to tiie user at 

obtain a great deal of useful information about the content of workstation 74. In effect, it would appear tiiat tiic threshold, 

die video sequence at a large savings in storage capacity. 65 described above as being static would become dynamic and 

An additional use for the analysis provided for tiic rcfK^- would raise or lower depending upon the trafSc in die 

ence video is in a network system for video systems. As network. Efifectively, tiie busier flie network ttie hi^K- die 
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threshold. If the network has litUe traffic, the threshold 
would appear to drop and the entire video sequence may be 
transmitted at full speed to the user without dropping any 
frames. If the network becomes busier, the system drops 
video frames beginning with those with the weakest transi- 5 
tion values first and then as traffic increases video frames 
widi stronger transition values will be dropped. Obviously, 
there is a level at which the user may find the images of the 
video sequence too choppy for his or her use and may issue 
a command to the file server simply to delay sending any lo 
video image data until such time as the full image video data 
may be transmitted. However, for some purposes the 
dynamic reference video sequence of images may be suffi- 
cient for the user's purposes. 

While there have been shown and described what are at 15 
present considered the preferred embodiments of the present 
invention, it will be obvious to those skilled in the art that 
various changes and modiiications may be made therein 
without departing from the scope of the invention as defined 
by the appended claims. 20 

What is claimed is: 

1. A method for compressing a sequence of a plurality of 
video frames on a computer system, comprising the steps of: 

analyzing eadi of the frames to determine a value for a 
selected characteristic of each frame; ^ 

assigning a diaracteristic value to each frame dependent 
on the analysis of the selected characteristic; 

establishing a threshold level related to a characteristic 
value; 

con:q)aring the characteristic value of succeeding frames 
to preceding frames; 

deleting from the sequence those fr^es whose diarac- 
teristic value is less than the threshold value; 

whereby the plurality of video frames are compressed into 35 
a video sequence the numbo* of whose frames is 
reduced in number and; 

displaying the compressed video sequence. 

2. The method of claim 1 wherein the step of analyzing 
each frame includes the step of establishing a grid pattern for 40 
each frame, the grid pattern cocresponcting to a selected 
number of pixels on eadi frame, flie step of analyzing furtiiex 
including the calculation of the characteristic value at each 
pixel on the grid. 

3. The method of daim 2, wherein the characteristic value 4s 
is the color value for each pixel. 

4. The method of daim 3, wherein an overall character- 
istic value for each fr^me is calculated by the further stsp of 
summing the individual color values at each pixel 

5. The method of claim 4, wherein die summing step is 50 
performed in accordance with the formula: 

rcO=E&y Red(P£f>Grtei<Py>+Bhie(/»i/) 

whereTCCrqjresents theTotal Color Value of the fi-ame; 55 

where P represents a pixd located in frame; 

where Pij represents die value of die pixel located at the 

ith row and the jth vertical coluimi in die grid of pixds; 
where Red, Green and Blue rqiresent the color values for 

the three colors red, green and blue of the pixel in the go 

ith row and jtti column. 

6. The method of daim 2 wherein the sdected character- 
istic of each fr^me is the color value of each pixel in die grid. 

7. The method of claim 6 further conqjrising die st^ cf 
detomining an overall color value for each frame is calcu- 65 
latcd by die further step of summing the individual odor 
values at each pixel 



8. The mediod of claim 7 wherein die summing step is 
pcd'ormcd in accordance with the formula: 

TCOSij Red(ft>>Grten(iVHBhje(Pii) 

where TCC represents die Total Color Value of the frame; 

where P represents a pixd located in frame; 

where Pij represents the value of the pixd located at the 

idi row and the jtii vertical column in the grid of pixds; 
where Red, Green and Blue represent the color values for 

the three colors red, green and blue of the pixd in the 

idi row and jdi column. 

9. The method of claim 8 wherein the st^ of establishing 
a tfureshold levd related to the characteristic vahie comprises 
the step of determining a value related to TCC. 

10. The method of claim 1 further comprising die step of 
deleting frames of the video sequence whose TCC is less 
than the value established in the step of establishing a 
threshold value and retaining those frames of the video 
sequence which equal or exceed the threshold level TCC 

11. A method of visualizing for a user the informational 
content of a sequence of video frames in a computer system* 
the con:q)Uter system including a display screen for display- 
ing the video frames, comprising the steps of: 

establi^iing a grid pattern for each video fr^mc, the grid 
pattern corresponding to a selected number of pixels on 
each frame, the step of analyzing further induding the 
calculation of the characteristic vdue at eadi pixel on 
the grid, wherein die grid is fanned of pixeb in i rows 
and j columns; 

sdecting a slice of each frame in the video sequence 
which is i rows wide and j columns high, wherein i and 
j are less than the total number of i rows and j columns 
of die frame; 

arranging each slice of each frame in accordance with the 

sequence of video frames; and; 
displaying the arranged slices of video frames on the 

display screen. 

12. The method of daim 11, further comprising selecting 
a slice whidi is 1 pixds wide and j columns high. 

13. The method of daim 11, further comprising the step 
of sdecting a slice whidi is a center slice of the i rows. 

14. The mediod of claim 11 wherein the display screen 
indudes a display of a timeline representing the time dura- 
tion of the video sequence, the timeline being displayed in 
dose proximity to the arranged slices of the video frames, 
die timeline further comprising a marker displayed on the 
timeline to be sdectively moved along the timeline, 
whereby the marker may be moved along the timeline, 
enabKng the user to assodate a particular time in the 
timeline with a partiodar video fr^me represented by a video 
frame slice. 

15. A method f<s dividing a sequence of a plurality of 
video frames on a computer system into scenes, the com- 
puter system including a di^lay screen for displaying 
indida of a change of scene along a longitudinally-disposed 
portion of die display screen, comprising the steps of: 

analyzing each of the frames to determine a value for a 

sdected characteristic of each fi^e; 
assigning a characteristic value to each frame dqiendent 

on die analysis of the sdected characteristic; 
establishing a threshold levd related to a change of scene; 
comparing the cfaaractCTistic value of succeeding frames 

to preceding frames; 
indicating a change of scene when die diaracteristic value 

exceeds the threshdd levd; 
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displaying the indicia of scene change along the 
longitudinally-disposed portioD of Ae display saeen 
for eadi a change of scene; 

whereby the longitudinally-disposed portion of the dis- 
play screen displays a sequence of indicia indicating ^ 
changes of scene. 

16. The method of claim 11 further comprising the step of 
displaying on the display saeen with the displayed arranged 
slices the full sequence of video frames in a compressed 
reduced format lO 

17. In a network system having a central file server, a 
plurality of computer workstations, the file serva and the 
workstations being connected to communicate widi the file 
server for the purpose of retrieving and processing video 
images stored on the file server and wherein the level of 
activity varies with the use of the workstations, a method of 
increasing the throughput of video images from the file 
server to a selected workstation, comprising the steps of: 

analyzing each of the firames to determine a value for a 
selected characteristic of each frame; 
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assigning a characteristic value to each frame dependent 
on the analysis of the selected characteristic; 

comparing the characteristic value of succeeding frames 
to preceding frames; 

establishing a threshold level related to a characteristic 
value and to the level of activity on the network systan 
such that as activity on the network system increases, 
the threshold level increases and as the activity on the 
networic decreases, the threshold level decreases; 

deleting from the sequence those frames who character- 
istic value is less than the threshold value; 

whereby frames are deleted as a proportional function of 
the activity on the network system before being dis- 
played at a workstation; and. 

displaying the compressed video sequence. 

***** 
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